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Abstract —We consider the discrete memoryless degraded 
broadcast channels with feedback. We prove that the error 
probability of decoding tends to one exponentially for rates 
outside the capacity region and derive an explicit lower bound of 
this exponent function. We shall demonstrate that the information 
spectrum approach is quite useful for investigating this problem. 

I. DEC WITH Eeedback 

Let and Z be finite sets. The broadcast channel we 

study in this paper is defined by a discrete memoryless channel 
specified with the following stochastic matrix: 

= (1) 

Here T is a set of channel input and y, and Z are sets of two 
channel outputs. We assume that those are finite sets. Let X” 
be a random variable taking values in Y". We write an element 
of T" as cc" = XiX 2 - ■ ■ Xn- Suppose that X" has a probability 
distribution on Y" denoted by px”. = 

Similar notations are adopted for other random variables. Let 
yri g yn g yn random Variables obtained as the 

channel output by connecting X" to the input of channel. We 
write a conditional distribution of on given X" as 

Since the channel is memoryless, we have 

n 

W^{y'^,z^\x'^) = \{W{yt,Zt\xt). ( 2 ) 

t=i 

In this paper we deal with the case where the components 
W{z^y\x) of W satisfy the following conditions: 

W{y,z\x) = Wi{y\x)W 2 iz\y). (3) 

In this case we say that the broadcast channel W is de¬ 
graded. The degraded broadcast channel (DEC) is specified 
by (lUijlUj). Let and be uniformly distributed ran¬ 
dom variables taking values in message sets and 
respectively. The random variable is a message sent to 
the receiver 1. The random variable L„ is a message sent 
to the receiver 2. In this paper we consider the case where 
we have feedback links from the receivers 1 and 2 to the 
sender. Transmission of the message pair (A"„,L„) via the 
DEC with feedback is shown in Lig. [T] A feedback encoder 



Fig. 1. Transmission of the message pair (Kn,Ln) via the DBC with 
feedback. 


denoted by (p^ = {ipt}t=i consists of n encoder functions ipt, 
f = 1, 2, • • •, L, where for each f = 1, 2, • • •, n, 

: /C„ X Cn X X Yt 

is a stochastic matrix. Lor a given message pair (fc, /) G K-n x 
Cn and given feedback signals G T” form the receiver 

1 and z^~^ G Z^ from the receiver 2, conditional provability 
of a;" G T" by ip'^ is 

n 

The t-ih transmission in the DBC with feedback is shown in 
Fig. 12 The joint probability mass function on /C„ x x T" 
xT" xZ” is given by 

Pr{(X„, X", Y", Y") = (fc, I, x^, y”, z^)} 

n 

= ir lir I ]li'^t{xt\k,l,y*-^,z*-^) 

xWi {yt |a;t) IU 2 {zt |yt)}, 
where |X„| is a cardinality of the set /C„. We set 

PK^Lr.x^Y^'Z^ {k, I, x", y", z”) 

= Pr{(X„, X", Y", Y") = (fc, I, x", y", z")}. 

Ey an elementary calculation we can show that for each (/, x", 
yti^z^) G Cn xX" xT" xZ", the probability ( 

Z,x", y'^,z'^) is given by 

n 

x-Wi{yt\xt)W2{zt\yt)}. 




















Fig. 3. Transmission of messages via the degraded BC. 


Fig. 2. The t-th transmission in the DBC with feedback. 


The decoding functions at the receiver 1 and the receiver 2, 
respectively, are denoted by ■0^"^ and Those functions 

are formally defined by : V" —> ■ 

The average error probability of decoding on the receivers 1 
and 2 is defined by 

= ^ A'„ or ^ L„} 

For k £ ICn and I £ set Vi{k) = {y" : = 

k}, T>2(0 = {z^ ■■ The families of sets 

{T>i{k)}k^ic„ and {X> 2 ( 0 }ie-C„ are called the decoding re- 

^ (n) 

gions. Using the decoding region, pg can be written as 

pSb = pSb(»>",V-1”'.#>) 

1 


E 


E 


\ICn\\Cn\ 

' " ' {k,l)eK„xC„ (x",!/",2")gA’"x3;"x2:": 

y'*ei>i(fc) or z''&t> 2 {i) 

x<f^ix^\k, /, z”-i)lU”(y”|a:”)W'2”(z”|y”). 

The average correct probability of decoding is defined by 

Pi^t^B = PSB(^^^^”^4”^) = 1 - 

On the other hand, transmission of messages via the DBC 
without feedback is shown in Fig. [3] In this figure, is a 
stochastic matrix given by 

= {(^(")(a:"|fc,0}(M.xO6K:„x£„xA'^, 

where (p^'^\x^\k,l) is a conditional probability of cc" £ T”” 
given message pair (fc, 1) £ /C„ x Let the average error 
probability of decoding in the case without feedback be 
denoted by Pe . This quantity has the following form 


p(n) _ 


1 


\ICn\\Cr, 


E 


E 


ik,l)eK„xC„ {x^,y^,z")<zX"'xy"-xZ’'-. 

y"ei>i(fc) or z"ei> 2(0 


X (x" |fc, over ( 2 /” 1 ^”) VF 2 ”(^” I 2 /”) ■ 

The average correct probability of decoding is defined by 

p(n) ^ ^ 1 _ 

For e £ (0,1), a pair (Ai, A 2 ) is e-achievable if there exists 
a sequence of triples {((^"', V' 2 ”^)}™^! that 

pSB(r,<', 4 ”')<E. 

liminf — log |/C„| > i?i, liminf — log |C„| > R^- 

n—^oo Tl n —^00 ft 


The set that consists of all e-achievable rate pair is denoted 
by CDBC,FB(£|kFi, 1 ^ 2 ). Furthermore, set 

CDBC,FB(kFl, 14^2) = Pi CDBC,FB(e|kFi, kF 2 )- 
ee(O.l) 

We define the capacity region CDBc(£|bFi, W 2 ) in the case 
without feedback in a manner quite similar to the defini¬ 
tion of CDBC,FB(£|kFi, W 2 ). We define the capacity region 
CDBc(bFi, IT 2 ) of the DBC without feedback in a manner 
quite similar to the definition of CDBC.FB(kFi, 142). 

To describe Cdbc(IPi) 142), we introduce an auxiliary 
random variable U taking values in a finite set U. We assume 
that the joint distribution of (f/, X, Y, Z) is 

PuxYz{u,x,y,z) 

= Pu{u)px\u{x\u)Wi{y\x)W 2 {z\y). 

The above condition is equivalent to U X £Y Y £Y Z. 
Define the set of probability distribution p = puxYZ of (C/, 
V, Y,Z) £U xX xy xZ by 

7?(14^i,14^2) = {p: < l-Tl + 1, 

PYIX = Wi,pz\Y = 142, u X £YY £Y Z}. 

Set 

C{p)= {(i?i,A2) :i?i,i?2 >0, 

i?i </p(V;r|C/),i?2 <4(C/;Z)}. 

C(VFi,VF2)= U C{p). 

p&V{Wi,W2) 


The broadcast channel was posed investigated by Cover [T]. 
Previous results on the capacity region for the DBC are given 
by the following theorem. 

Theorem 1 (m-m: For each fixed e £ (0,1) and any 
DBC (4 Fi, 142), we have 

CDBc(e| 14 ^i, 14^2) = Cdbc( 1 Pi, 14^2) 

= C(Wi,lU2). 

A previous result on Cdbc,fb( 1 Ti, W2) is given by the 
following theorem stating that the feedback can not increase 
the capacity region for the DBC. 

Theorem 2 (El Gamal m): For any DBC (4Ui,W2 ), we 
have 


Cdbc.fb( 1 Fi, W2) = Cdbc(Wi, 14^2) 
= C(14^i,W'2). 
























In general broadcast channels the feedback can increase the 
capacity region. Previous works on the coding problem for 
broad cast channels with feedback are summarized in fS). 

in) 

To examine an asymptotic behavior of pg for rate pairs 
outside the capacity region we define the following quantity. 

G^^l{Ri,R2\Wi,W2) 

A .( I 

(1/n) log 

(1/n) log |£„|>it 2 

GYJi{Ri,R 2 \Wi,W 2 ) = lim 4 B(i?i,i? 2 |VPi,VF 2 ). 

n—^oo 

The quantity G'FB(i?i, i? 2 |W^i, W^ 2 ) is the optimal exponent 
function for the correct probability of decoding at rate pairs 
outside the capacity region. In the case without feedback we 
define the optimal exponent function i? 2 |M^i, ^^ 2 ) for 

the correct probability of decoding for rate pairs outside the 
capacity region in a manner quite similar to the definition of 
GFB(i?l,i? 2 |M"l,M" 2 ). 

Define 

uj[G(^x,y,z\u) 

A , qY\x{y\x) , , (lz\ui.z\u) 

= Mlog- . I . + log . s , 

qY\u\y\u) qz{z) 

AG^>'){XYZ\U) 

= X! qux{u,x)qY\x{y\x)qz\Y{z\y) 

{u,x,y,z)^Ux^ xyxZ 

xexp|Awl'"l(x, 2 /,z|u)|, 

nM(^XYZ\U) = \ogAll^’^\XYZ\U), 

fl^^’^'^(Wi,W 2 )= max nG’^UXYZlU), 
qGV{Wi,W 2 ) ^ 

A X{nRi +R 2 )- (Wi, W 2 ) 

1 + 2A +A/r 


Theorem 3: For any DEC (lFi,lT 2 ), we have 

G(i?i,i?2|M"i, 1 ^ 2 ) > F{RyR2\WuW2). (4) 

It follows from Theorem [3] and Property [T] part c) that 
if (i?i,i? 2 ) is outside the capacity region, then the error 
probability of decoding goes to one exponentially and its 
exponent is not below F{Ri,R 2 \Wi,W 2 )- 

Our result in the case of feedback is the following. 

Theorem 4: For any DEC (Wi, W 2 ), we have 

GFB(-Rl,i?2|M^l,VF2) > F{RyR2\WyW2). (5) 

It is interesting that the exponent function F(i?i,i ?2 
\Wi, W 2 ) also serves as a lower bound of the optimal exponent 
function Gyb{RitR 2 \W\,W 2 ) in the case of feedback. This 
result strongly suggests a possibility that the feedback can not 
improve the optimal exponent function for the probability of 
correct decoding at the rate pairs outside the capacity region. 

From this theorem we immediately follows from the fol¬ 
lowing corollary. 

Corollary 1: For each fixed e G (0,1), and any DEC 
(FFi, IT 2 ), we have 

CDBC,FB(e|14^1, W 2 ) = Cy)bc{s\Wi,W2) 

= C^bc{WuW2) = C{WuW2). 

Outline of the proof of Theorem 0] will be given in the next 
section. The exponent function at rates outside the channel 
capacity in the case without feedback was derived by Arimoto 
0 and Dueck and Korner M- The exponent function at 
rates outside the channel capacity in the case with feedback 
was derived by Csiszar and Korner im. They show that 
feedback can not improve the reliability function for the DMC 
at rates above capacity. The techniques used by them are not 
sufficient to prove Theorem |3] Some novel techniques based 
on the information spectrum method introduced by Han ifT^ 
are necessary to prove this theorem. 


iogp("4(^",V’[ 


(n) 


c,FB 




F{Ri,R2\Wi,W2) 

A XitiRi+R2)-n^f^’^HWi,W2) 

f2,x>o 1 + 2A + A/j, 

We can show that the above functions and sets satisfy the 
following property. 

Property 1: 

a) For each q G V{Wi,W 2 ), n[^'^\xYZ\U) is a mono¬ 
tone increasing and convex function of A > 0. 

b) For every q G P(Wi, IF 2 ), we have 

lim \XYZ\U) ^ ^j^^x-Y\U) + Iq{U-Z). 
A—>^+0 A 

c) If (i?i,i? 2 ) i C( 1 Ti,W' 2 ), then we have i? 2 | 

WyW2) > 0 . 

The author 0 obtained the following. 


II. Outline of the Proof of the Main Result 

In this section we outline the proof of Theorem 0] We first 
prove the following lemma. 

Lemma 1: For any 77 > 0 and for any ) 

satisfying (1/n) log |/C„| > i?i, {1/n) log |£„| > i? 2 , we have 


p 1 fb(‘F"’) V' 

Ri<- log 
n 

i ?2 < - log 
n 


1 ,^2 )<PL^X^Y^Z^< 

Pz^\lAZ^\L 
qzr^iZ^) 



(6) 

(7) 


In we can choose any conditional distribution qY’<-Z"-\L„ on 
yn ^ 2 :" given Lji G In (|7]) we can choose any probability 
distribution qz^ on Z". 









Proof of this lemma is given in Appendix iBl For t = 1,2, 
■ ■ ■ ,n, set 

Ut = CnX X Vt = £„ X 

Ut = {Lr„Y*-\Z*-^)€Ut,Vt = e Vt, 

ut = (1, 2/‘“\ 2;*“^) e Ut, Vt = [I, z*~^) £ Vf 

For each f = 1, 2 •••,/, let /ct be a natural projection from Ut 
onto Vt- Using Kt, we have Vt = Kt{Ut), t = 1, 2, • • •, n. For 
each t = 1 , 2 , • • •, n, let Q{Ut x A’x 3 ^ x Z) be a set of all 
probability distributions on 

UtxXxyxz = CnxXxy^xzK 

For t= 1, 2, • • •, n, we simply write Qt=Q{Ut xX xyx Z). 
Similarly, for f = 1, 2, • • •, n, we simply write qt = qutXtYtZt 
£ Qt- Set 


n n 


Q" = I[Qt = l[QiUt X X X y X z), 




1 

Ri < - Vlog 

n 








R 2 < -Y] log 




+ 77^+26-”’'. 


Proof: In ® in Lemma [T] we choose qz^Y'^\L„ 
qY^Z”-\Ln{y'^, 

n 

t=l 

X QZt\LnY*z*-^{zt\l,y^,z^~Y 

n 

= Y[{qYt\L„Y^-^zt-^{yt\l,y*~^,z^~^)W2{zt\yt)}- 

In (I?]) in Lemma [TJ we choose qz^ having the form 

n 

qzr^{Z-) = l[qzAZt)- 

Then from the bound (l7|i in Lemma [T] we obtain 

<Fl„X"Y"Z" 


i?i < - V log 

n 


Wi{Yt\Xt) 




9yt|L„Y‘-iZ*-i (^tlUra, U* 1 ) 


V, 


1 " 

R 2 < - Y log 

n 




qzAZt) 


+ il\+2e-^\ 


completing the proof. ■ 

From Lemma |2] we immediately obtain the following 
lemma. 

Lemma 3: For any 77 > 0, for any ((^", t/j) satisfy- 
ing ^ ^ 

- log |/C„| > Ri, - log \Cn\ > R2, 
n n 

and for any q'^ G Q^, we have 


r = {qt}Y e Q”. 

From Lemma [T] we have the following lemma 
Lemma 2: For any rj > 0 and for any , tjj^\ ) 
satisfying 

- log |/C„| > Ri, - log |£„| > R2- 
n n 

we have 

WAYt\Xt) 


)(^) 

c,FB 


Y <PL„X^Y^Z- 


WAYt\Xt 


1 " 

772 <-Slog 5242 ^ 

nfri qzAZt) 


Vr]\+2e-^\ 


( 8 ) 


where for each t = 1,2, - ■■ ,n, the conditional probability dis¬ 
tribution qYt\Ut probability distribution qz^ appearing 

in the first term in the right members of (| 8 ll are chosen so 
that they are induced by the joint distribution qt = qutXtYtZt 

£ Qt- 

Here we define a quantity which serves as an expo¬ 
nential upper bound of ® in Lemma [3] To describe this 
quantity we define some sets of probability distributions. 
Let T^pb^ (FFi, W 2 ) be a set of all probability distributions 
P_L"X"Y’‘Z" on Cn XT’" xy^ xZ" having the form: 


Pl^x^y^z^ (Z, x", 7/", z” 


= PLr^{l)Y[{PXt\L„xt-^Yt-^zt-Axt\l,x* \y* '^,z^ 

xWi{yt\xt)W2{zt\yt)}- 

For simplicity of notation we use the notation for 

PL„X"Y^Z" £ T’fb (lUi, W 2 ). We assume that putXtYtZt = 
PL„XtY*z* is a marginal distribution of For t = 

l,2,---,n, we simply write pt = PUtXtYtZt- For e 
T’fb (^ii IP 2 ) and £ Q", we define 

A 


logEp(„) 


Vr wlAYt\Xt) P%\vAZt\Vt) 

11 


t\Y\uSYUt) q^Zt) 

where for each f = 1 , 2 , • • •, tt,, the conditional probability dis¬ 
tribution qYt\Ut '^Fe probability distribution appearing 
in the definition of are chosen so that 

they are induced by the joint distribution qt = qutXtYtZt G Qt- 
Set 

n|rB"^(iUi,iu2) 

= sup max min —LlAf?..-„^(X'^Y'^Z'^\Ln)- 

Then we have the following proposition. 

Proposition 1: For any 0 > 0,p > 0, we have 


GMRyR2\WyW2) > 


e{pRi + R2)-n^Af{Wi,W2) 
1 + ^(1 + //) 












Proof of this proposition is in Appendix |C] We shall 
call W 2 ) the communication potential. The above 

corollary implies that the analysis of Wi, W 2 ) leads to 

an establishment of a strong converse theorem for the degraded 
BC with feedback. 

The following proposition is a mathematical core to prove 
our main result. 

Proposition 2: For 6 € (0,1), set 


A = 


e 

1-6 


^0 


A 

1 +A' 


(9) 


Then, for any 6 S (0,1), we have 


[8] O. Shayevitz and M. Wigger, “On the Capacity of the discrete memory¬ 
less broadcast channel with feedback, IEEE Trans. Inform. Theory, vol. 
59, no. 3, March 2013, 1329-1345. 

[9] S. Arimoto, “On the converse to the coding theorem for discrete 
memoryless channels,” IEEE Trans. Inform. Theory, vol. IT-19, no. 3, 
pp. 357-359, May 1973. 

[10] G. Dueck and J. Komer, “Reliability function of a discrete memoryless 
channel at rates above capacity,” IEEE Trans. Inform. Theory, vol. IT-25, 
no. I, pp. 82-85, Jan. 1979. 

[11] I. Csisz^ and J. Kdrner, “Feedback does not affect the reliability 
function of a DMC at rates above capacity,” IEEE Trans. Inform. Theory, 
vol.IT-28, pp.92-93, 1982. 

[12] T. S. Han, Information-Spectrum Methods in Information Theory. 
Springer-Verlag, Berlin, New York, 2002. The Japanese edition was 
published by Baifukan-publisher, Tokyo, 1998. 


i + A 

Proof of this proposition is in Appendix iDl The proof is not 
so simple. We must introduce a new method for the proof. 
Proof of Theorem^ For 9 € (0,1), set 




A 

1 + A' 


( 10 ) 


Then we have the following: 


GFB(-Rl,i?2|lVi,W'2) 

6(pEi + Ii2)-nl^B'\Wi,W2) 

1 + ^(1 + /i) 

(b) ^(f,B,+E,)-^n(MP)(Wi,W2) 

1 + 1^(1 + m) 

_ A(pEi + E 2 ) - 

1 + A + A(1 + /i) 

= +i? 2 |lVi,fV 2 ). ( 11 ) 


Step (a) follows from Proposition [T] Step (b) follows from 
Proposition |2 and (fTOl i. Since (fTTI) holds for any positive A 
and p, we have 


Appendix 


A. Cardinality Bound of Auxilary Random Variables 

We prove the following lemma. 

Lemma 4: For each integer n > 2, we have 

= max (XY Z\U) 

q=quXYZ.U^X^Y^Z, ^ 

qY\x—Wl^qz\Y—W2, 

\u\<\Cr.\\yr-^\zv-^ 

= max Z\U) 

q=quXYZ.U^X^Y^Z, '■ 

qY\X=V/l,qz\Y=V/ 2 , 

\u\<\x\ 

Proof: We bound the cardinality \U\ of U to show that the 
bound \U\ < \X\ is sufficient to describe (lVi,W 2 ). 

Observe that 


Gfb{Ei,E2\Wi,W 2) > F{Ei,E2\Wi,W2). 

Thus (|5]l in Theorem 0] is proved. 
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where 

= qx\u{x\u)Wi{y\x)W 2 {z\y) 

{x,y ,z)^X xy X Z 
X exp|Aa;(G(a;^y^2:|u)| 

are continuous functions of qx\u{'\u) ■ Then by the support 
lemma, 

\U\ < |A '|-1 + 1 = |A’| 

is sufficient to express |A’| — 1 values of (fT2l i and one value 

of (US- ■ 










B. Proof of Lemma [7] 


A 1 < e We have the following chain of inequalities: 


In this appendix we prove Lemma [T] 
Proof of Lemma\If For Z G set 


A 


Ai{l) = : W^{z^\y^)Wf(y^\x^) 


A 


A2{1) = : Pz.|L„(z"|Z) > \C„\e-^^qz^iz^)}, 


A 


A{1) = Aiil)r\A2il). 

Then we have the following: 


p(n) _ 1 

lICnWCr, 


■ E E _ 1 

{k,l)^ICnXCn (a:'™,y”',z^)G^(/), 
y^€Vi{k),z^eV2{l) 


Xpx^Y^Z^\Kr^,Lr, (a;"j 0 

E E 1 


lICnWCr, 


{k,l)eK.„xC„ (a;",y",z’*)e^'=(/): 

y"eI5i(fe).z"eI52(0 


xpA"y"Z"|jf„,L„ (a:", y”, z'^\k, 1) 

< E 


2 = 0 , 1.2 


where 


Ai = 


1 


E 


E 


y’'G'Di{k),z"G'D2{l) 

wr{y"^\xAW2(z’^\yA 

<e-"’>|/C„| 

|i,„ (y"i 2 ” 10 

xf-{x-\k, I, y'^-\z--^)Wf{y^\x^)W^iz^\yn 

^—nr] _ _ 

^kr S ^ ' 

{k,l)^Kn xCn (x^ ,y'^ ,z‘^): 

y'^ G'Di{k) GT>2{1) 

xf^ix^lk, I, y”-\ z"-')gynz"|L„(yk zll) 
yF"Z"|L„ ( 2 ?l(fc) X ^ 2(01 0 


|7:„ 


{k,l)eK„xCn 


^-ny 


- E E (^^i(fc)i 0 


iG£„ fee/c„ 


|7:„ 


E ( [J T^i{k) 


l&Cn 


^fcGK:„ 


< 


\C„ 


Ei = ' 


;g£„ 


Next we prove A 2 < e We have the following chain of 
inequalities: 


An = 


\}Cn\\C„ 


E E 


(fe.i)e/C„x£„ (a;",y",z")e^(/) 

Xtonr"Z"|x„.L„k”, y", ^” 1 ^, 0 . 


A,; = 


E 


E 


\}Cn\\Cn\ 

' "" (fe.i)e/c„x£„ (x",j/",z")e^n0, 

y"ex>i(fc).z"ei52(0 

xpx"y"Z"|iv„,L„k"', y", z”|fc, /) 
for 1 = 1,2. 


1 


By definition we have 

ko 

= Pl^x^y^z 

1 . , 1 , WPiYAXAWfiZAYA 

- log |/C„| < - log - vn Zn\ T \ 

n n qYnzn\L„(X^,Z^\Ln) 

-log|/:„| < -log-^———- Yy}. (14) 

n n qz^(Z^} j 

From (fT4l) . it follows that if {ipA) satisfies 

- log |/C„| > i?i, - log \Cn\ > i? 2 , 
n n 


then the quantity Aq is upper bounded by the first term in 
the right members of (|7]) in Lemma [T] Hence it suffices to 
show Ai < = 1,2 to prove Lemma [T] We first prove 


At = 


1 


\C. 


E E 


1 


< 


< 


{k,l)GKnXCn 

y’*GX>i(fc),z”Gr>2(0 

x|£„|gzn(z'*) 

xpiv„A"Y"Z"|L„ (fc, a:”, y”, z"|Z) 

^E E E E 
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Thus Lemma [1] is proved 


C. Proof of Proposition Q] 

In this appendix we prove Proposition [T] We use the 
following lemma, which is well known as the Cramer’s bound 
in the large deviation principle. 


















Lemma 5: For any real valued random variable Z and any 
0 > 0 , we have 

Pr{Z > a} < exp[— (Aa — logE[exp(0Z)])]. 

By Lemmas [3 and |5] we have the following proposition. 
Proposition 3: For any p,, 9 > 0, any , tjj^\) 
satisfying 


-log|/C„| > i?i, -log|£„| > i?2, 

n n 


and any g" £ Q”, we have 
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2 e“ 
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exp|^n|— 0 (/ri?i + R 2 ) + 6{p + l)p 




+ 2 e-”''. 


— t] = -d{pRi + R 2 ) + 9{p + l)p 

Solving (fTTl i with respect to p, we have 
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9{pR^ + R 2 ) - 


1 + ^(1 + /^) 

For this choice of 77 and (UHi, we have 
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^c,FB — 00 


= 3 exp < -n- 
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Proof of Proposition [7] By the definitions of 


i? 2 |fFi, W 2 ) and np^^l(FFi, IL 2 ) and Proposition [3 we have 
G^^l{Ri,R2\Wi,W2) 

^9{pR,+R2)-TiTiW,,W2) 1 ,_ 

^ 1 + 0(1 + ^) 

From (fTSl) . we have Proposition [T] ■ 

(15) D. Upper Bound of fl^^\Wi,W 2 ) 

In this appendix we drive an explicit upper bound of 
W 2 ) to prove Proposition |3 For each f = 1,2, 
■ ■ ■ ,n, define the function of {ut,Xt,yt, zt) G Vt xX xy 
xZ by 


FB v-n-ii 


A Y/l^^{yt\xt)p%^^y^{zt\vt) 


Proof: Under the condition (fTSl) . we have the following 
chain of inequalities: 


For each f = 1,2, • • •, n, we define the probability distribution 
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Step (a) follows from Lemma[3 Step (b) follows from Lemma 
13 We choose y so that 


are constants for normalization. For each t = 1, 2, • • •, n, set 
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where we define Go = 1. Then we have the following lemma. 
Lemma 6: 
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Proof: From (fTOl l we have 
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From dTTli and (l22li . (l20l i is obvious. ■ 

The following lemma is useful for the computation of 
L for f = 1 , 2 , • • •,: 




completing the proof. 













Lemma 7: For each t = and for any (/, 

x*,y*,z*) € jCn xy* xZ*, we have 
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Proof: By the definition of P''L^xYiZi x*,y*,z*), t = 
1, 2, • • •, n, we have 
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completing the proof. 

We set 


Pu’xt \ut,xt) 




, t-i 


x*-i 


(ut,a;‘ )pxt|c/tX‘-i(a;t|wt,Z ^). 


p(M.e) 
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Proof of Proposition |2] is as follows. 

Proof of Proposition Set 

Vn(Wi,W 2 ) = {q = quxYz ■ \u\ < |£„||3^r-i|zr-\ 
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Step (a) follows from Holder’s inequality. Step (b) follows 
from Step (c) follows from qt G ^n(lEi,H 2 ) and the 
dehnition of (fEi, H 2 ). Step (d) follows from Lemma|4] 
in Appendix IaI To prove this lemma we bound the cardinality 
|V| appearing in the dehnition of (fEi, IT 2 ) to show that 
the bound \U\ < \X\ is sufficient to describe IT 2 ). 

Hence we have the following: 
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Step (a) follows from (l20l i in Lemma |6] Step (b) follows from 
(I 30 I 1 . Since OTI) holds for any n > 1 and any G VpB 
(VEi, H 2 ), we have 


1 + 7 


Thus, Proposition |2] is proved. 

















